منابع مشابه
Convergence of Best Entropy Estimates
Given a finite number of moments of an unknown density on a finite measure space, the best entropy estimate-that nonnegative density x with the given moments which minimizes the Boltzmann-Shannon entropy I(x):= x log x-is considered. A direct proof is given that I has the Kadec property in L-if Yn converges weakly to 37 and I(yn) converges to I(37), then yn converges to 37 in norm. As a corolla...
متن کاملEntropy Estimates for Dynamical Systems
We apply a method proposed recently for estimat ing entropie s of sy mbol sequences to two ensembles of binary seq uences obtained from dynamical sys tems. T he first is th e ensemble of (0,1)sequences in a generating part it ion of the Henon map ; th e second is th e ensemb le of spat ial st rings in cellular automaton 22 in t he stat ist ica lly stat ionary state. In both cases , t he ent rop...
متن کاملEntropy Estimates for Generative Models
Different approaches to generative modeling entail different approaches to evaluation. While some models admit test likelihood estimation, for others only proxy metrics for visual quality are being reported. In this paper, we propose a simple method to compute differential entropy of an arbitrary decoder-based generative model. Using this approach, we found that models with qualitatively differ...
متن کاملAdder MAC and estimates for Rényi entropy
This paper discusses a possible program for improving the outer (converse) bounds on the finite-blocklength performance of multiple-access codes. The program is based on a certain conjecture involving Rényi entropy of a sum of two independent binary vectors. Some partial results towards showing the conjecture are presented. The problem of bounding the joint Rényi entropy in terms of the margina...
متن کاملEntropy estimates of small data sets
Abstract. Estimating entropies from limited data series is known to be a non-trivial task. Näıve estimations are plagued with both systematic (bias) and statistical errors. Here, we present a new “balanced estimator” for entropy functionals (Shannon, Rényi and Tsallis) specially devised to provide a compromise between low bias and small statistical errors, for short data series. This new estima...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Science
سال: 1977
ISSN: 0036-8075,1095-9203
DOI: 10.1126/science.198.4313.206